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METHOD AND APPARATUS FOR LOW DENSITY PARITY CHECK ENCODING OF 

DATA 



5 Background of the Invention 

1. Technical Field 

The present invention generally relates to a method and apparatus for low-density parity-check 
10 (LDPC) encoding of data and particularly relates to block encoding of data based on a parity 
check matrix for mapping the data into LDPC code words for binary and multilevel modulation 
for data communication and for recording systems. 

P 

In 2. Description of Related Art 

if 

f I| In Gallager: u Low-densitv paritv-check codes. Cambridge. MA. MIT Press 1963." , it is shown 
m that, based on message-passing decoders, it is possible to come extremely close to the channel 
^ capacity of the binary-input additive white Gaussian noise channel (AWGN). Since then, it has 
□ been shown that LDPC codes can come very close to capacity on many practical communication 
2(f and recording channels. Therefore, LDPC codes have been considered as an alternative to turbo 
= j codes. Specifically, LDPC codes exhibit a better asymptotic performance than turbo codes, they 

y 

k are less affected by error floors, and offer a variety of tradeoffs between decoder complexity and 
performance. An advantage of LDPC codes is the low implementation complexity of the 
sum-product algorithm that is used to decode them. Simplified versions of the sum-product 

25 algorithm drive complexity lower with negligible loss in decoding performance as compared to full 
sum-product decoding. 

In many magnetic recording applications such as hard-disk drives or tape systems, information is 
stored in binary form. In these applications, inner modulation codes concatenated with outer 
30 Reed-Solomon codes are employed to provide reliable extraction of the written information. Turbo 
and LDPC codes may push the areal density of magnetic recording systems to the limit for 
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presently available magnetic components. It has been shown that, despite present sector-size 
constraints of hard-disk drives limiting the block length of a code and the high code-rate 
requirement, simple iterative decoding schemes can bring performance within approximately 1.5 
dB of the theoretical limit. This represents a significant gain compared to existing systems. 
5 High-rate LDPC codes appear to have advantages over convolutional or turbo codes when used as 
outer codes in a magnetic recording system. For example, LDPC codes do not seem to suffer from 
error floors at error rates of 10" 8 . Furthermore, the sparseness of the parity-check matrix of LDPC 
codes results in decoding algorithms that are less complex compared to serially concatenated 
systems with convolutional outer codes. Also, no interleaver is needed between the LDPC encoder 
10 and the channel, because interleaving can be implicitly incorporated into the LDPC code. The 
potential gains of LDPC codes over the traditional Reed-Solomon codes for the magnetic 
recording channel have been presented in, T. Mittelholzer, A. Dholakia, and E. Eleftheriou 
O 'Reduced-Complexity Iterative Decoding of Low Density Parity Check Codes for Generalized 
$ Partial Response Channels." IEEE Trans. Mam.. 37(2), pp. 721-728, March 2001. I n magnetic 
|p storage systems LDPC codes are expected to push the areal density to its ultimate limit. 

u) In many communication systems, including both wired and wireless transmission systems, there 
r j are strict limitations on transmit signal bandwidth. Such limitations impose a demand for signal 
; ,5 -f modulation with a number of levels greater than two. Many conventional systems employ 

W Trellis-coded modulation (TCM) in such applications. However, a problem associated with TCM 

Q 

^ is that it is unsuitable for iterative decoding. Therefore, further improvements in signal quality at 
an acceptable complexity are difficult to achieve. 

"A turbo TCM scheme with low decoding complexity," Catena Netwoks Inc., Temporary 
25 Document BI-090, ITU-T Study Group 15. Question 4, Goa, India. 23-27 Oct. 2000, "Proposal 
of decision making for turbo coding and report of performance evaluation of proposed 
TTCMfPCCQ with R-S code and without R-S code. 1 ' Mitsubishi Electric Corp., Temporary 
Document BI-003, ITU-T Study Group 15, Goa. India, 23-27 Oct. 2000, and "Results of the 
requirements requested in the coding ad hoc report,' 1 Vocal Technologies Inc.. Temporary 
30 Document HC-073, ITU-T Study Group 15, Question 4, Huntsville, Canada, 31 July - 4 August 
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2000, describe turbo-coding schemes for multilevel ADSL and VDSL transmission. These 
turbo-coding techniques involve encoding of the information bits by parallel concatenation of 
convolutional encoders in recursive systematic form and iterative decoding by one of several 
possible turbo-decoding techniques. "Block product turbo codes for G.dmt.bis and G.lite.bis." 
5 Globespan Inc.. Temporary Document BA-063, ITU-T Study Group 15. Question 4. Antwerp, 
Belgium. 19-23 June 2000 describes the application of block product codes using component 
Bose-Chaudhuri-Hoequenghem (BCH) codes and their soft iterative decoding based on the Chase 
algorithm. These techniques offer some performance enhancements over Trellis coding at the 
expense of incurring additional complexity. 

10 

Application development relating to the alternative coding technique of LDPC codes, as 

described in R. G. Gallager. "Low-density parity-check codes." IRE Trans. Info. Theory, vol. 

IT-8. pp. 21-28. Jan. 1962. D. J. C. MacKav and R. M. Neal. "Near Shannon limit performance 
$ of low density parity check codes. Electron. Lett., vol. 32. no. 18. pp. 1645-1646. Aug. 1996, IX 
W J. C. MacKav. "Good error-correcting codes based on very sparse matrices." IEEE Trans, on 
[jj Inform. Theory, vol. 45. No. 2. pp. 399-431. Mar. 1999. and FOSSORIER. M.P.C.. 
^ MIHALJEVTC M.. and IMAL H.: "Reduced complexity iterative decoding of low density parity 
□ check codes based on belief propagation". IEEE Trans. Commun.. 1999. 47, (5). pp. 673-680 , 

has to date focussed on applications requiring binary modulation such as wireless systems or 

id digital magnetic recording. LDPC codes can also, however, be applied to multilevel transmission. 

U 



K. R. Narayanan and J. Li. "Bandwidth efficient low density parity check coding using multilevel 
coding and interative multistage decoding." Proc. Int. Svmp. on Turbo-Codes, Brest. France, pp . 
25 165-168. Sept. 2000 describes a multilevel coding technique based on binary LDPC block codes. 
This technique uses LDPC block codes for bit-interleaved modulation or for multilevel coding 
with iterative multi-stage decoding. For bit-interleaved LDPC modulation according to this 
technique, all the bits used to select a multilevel symbol are LDPC code bits. For multilevel 
coding, several LDPC block codes are used as component codes in a multilevel scheme. This 
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technique has the drawback of requiring more than one LDPC encoder/decoder, leading to 
substantial implementation complexity especially for long codes and/or large constellation sizes. 

u Low density parity check coded modulation for ADSL," Aware Inc., Temporary Document 
5 BI-081. ITU-T Study Group IS. Question 4. Goa. India. 23-27 October 2000 also describes a 
multilevel coding technique based on binary LDPC block codes. This technique is similar to TCM, 
except that LDPC coding is employed instead of convolutional coding. In particular, set 
partitioning follows the same principle as that used in TCM. This technique has the drawback of 
requiring an additional Bose-Chaudhuri-Hoeguenghem (BCH) code which adds to system 
10 complexity. Also, set partitioning, as required in TCM and similar schemes, leads to poor 
performance for soft-decision based decoding techniques. 

^ Temporary Document RN-25. ITU Telecommunications Standardization Sector. Study Group 15, 

W New Jersey. USA. 21-25 May 2001 describes a deterministic LDPC methodology and its 

□ 

f $ applications to ADSL and ADSL Lite transmission. The methodology proposed therein requires a 
precomputation of the a generator matrix using, for example, Gaussian elimination. The encoding 
requires OfN 2 ) operations. 



5 

£3 



lication 



i2 Co-pending IBM patent application rot o r(moo ^j9*2Q66^K?8^escribes a method for multilevel 
data communication comprising: dividing a set of information bits to be transmitted into a first 

□ 

U group and a second group; encoding the first group to generate a block code ; selecting a subset 
of symbols in a constellation of symbols in dependence on the block code according to a 
Gray-coded mapping function; selecting a symbol within the subset in dependence on the second 
group according to a Gray-coded mapping function; and, transmitting the selected symbol. This 

25 method offers superior performance in terms of achievable coding gains. The coding gains arise 
because block coding schemes can be decoded iteratively, thereby leading to substantial 
performance gains as compared to trellis-coded modulation. Particularly preferred embodiments 
of this method comprise multilevel encoding schemes based on LDPC codes or simple product 
codes that do not need interleaving and that can be decoded via the simple sum-product 

30 algorithm (SPA) or low-complexity derivatives thereof. 
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A disadavantage associated with LDPC codes is that they demand relatively high encoding 
complexity. When an LDPC code word is obtained by multiplying the information block with the 
generator matrix of the code, encoding requires OQ>P) operations, where N is the length of the 

5 code. Such an encoding procedure is not "linear in time." Furthermore, there is a preprocessing 
step needed to compute the generator matrix of the code from the specified LDPC parity-check 
matrix. The computation of the generator matrix involves Gaussian elimination, which requires 
OQtf) operations. Even though the preprocessing can be performed once for a particular LDPC 
check matrix and can be carried out offline, the computation cost can be prohibitive when 

10 decoding for applications requiring selection of one of a family of parity check matrices. This is the 
case, for example, in XDSL where the code is selected on a per connection basis. The topic of 
efficient encoding for LDPC codes has been addressed in L. Ping, W. K. Leung, and N. Phamdo. 

^ "Low density parity check codes with semi-random parity check matrix," Electron. Letters* Vol. 

5 35. No. 1, pp. 38-39. 7 th Jan. 1999; D. J. C. MacKav. S. T. Wilson, and M. C. Davev, 

T§ "Comparison of constructions of irregular Gallager codes," IEEE Tram, on Communications. 

\ [{ Vol. 47, No. 10. pp. 1449-1454. Oct. 1999 ; and, R. Richardson and R. L. Urbanke. "Efficient 

^ encoding of low-densitv parity-check codes. " IEEE Trans, on Information Theory. Vol. 47.. No. 

s 

O 2. pp.63 8-656. Feb. 2001. 

K 5 

2© In L. Ping, W. K. Leung, and N. Phamdo. "Low density parity check codes with semi-random 

£3 

U parity check matrix," Electron. Letters. Vol. 35. No. 1. pp. 38-39. 7 th Jan. 1999. the parity-check 
matrix of the LDPC code is "semi-random" in the sense that it includes a deterministic and a 
random part. The deterministic part is in a band-diagonal or "zigzag" form to allow efficient 
encoding. The rest of the parity-check matrix is created randomly by avoiding 4-cycles. In D. J. C. 

25 MacKav. S. T. Wilson, and M C. Davev, "Comparison of constructions of irregular Gallager 
codes," IEEE Trans, on Communications. Vol. 47. No. 10, pp. 1449-1454. Oct. 1999 and JL 
Richardson and R. L. Urbanke, "Efficient encoding of low-densitv parity-check codes, " IEEE 
Trans, on Information Theory. Vol. 47.. No. 2, pp.638-656. Feb. 2001 , the parity-check matrix 
is again generated by a random construction and a triangular or "approximate triangular" form is 
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imposed to allow efficient encoding. These constructions each lead to linear-time encodable 
LDPC codes. However, they have a number of drawbacks, including: 

(a) Randomly constructed parity-check codes cannot be specified via a small number of 
parameters. In other words, all the positions of the nonzero elements of the parity-check matrix 

5 must be individually given; 

(b) preprocessing is sometimes required to bring the parity-check matrix into triangular or 
approximate triangular form; and, 

(c) the codes obtained result in loss in performance as compared with randomly constructed 
LDPC codes. 

10 

In would be desirable to provide parity-check matrices that lead to LDPC codes having 
linear-time encoding complexity. It would also be desirable to provide parity-check matrices that 
k i are fully deterministic and can be specified via a small number of parameters. It would also be 
j$ desirable to provide parity-check matrices that require a minimum amount of, or no, 
preprocessing. 

CO 

II! 

Summary of the Invention 

Q 

^ In accordance with the present invention, there is now provided a method for low-density 
IP parity-check (LDPC) encoding of data, the method comprising: defining a first MxN parity check 
M matrix representative of the low density parity check code; generating, based on the first parity 
check matrix, a second parity check matrix having an MxM triangular sub-matrix; and, mapping 
the data into an LDPC code word based on the second parity check matrix. 

25 The method may further comprise eliminating 4-cycles from the second matrix. 

Alternatively, the defining of the parity check matrix may comprise cyclically shifting of rows of 
the first matrix to eliminate 4-cycles from the outset. Preferred embodiments of the present 
invention comprise setting entries along the main diagonal of the MXM triangular sub-matrix to 
the same value. 

30 
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Viewing the present invention from another aspect, there is now provided apparatus for 
low-density parity-check (LDPC) encoding of data, the apparatus comprising: matrix definition 
logic for defining a first MxN parity check matrix; a triangular matrix generator for generating a 
second parity check matrix based on the first parity check matrix; the second parity check matrix 
5 having an MxM triangular sub-matrix; and, an encoder for mapping the data into an LDPC code 
word based on the second parity check matrix. 

Viewing the present invention from yet another aspect, there is now provided a computer 
program product for low-density parity-check (LDPC) encoding of data, the computer program 

10 product comprising a machine readable storage medium storing computer program code which, 
when loaded in a programmable data processor, configures the processor to perform the steps of: 
defining a first MxN parity check; generating, based on the first parity check matrix, a second 

! parity check matrix having an MxM triangular sub-matrix; and, mapping the data into an LDPC 

"ok* 

tfl code word based on the second parity check matrix. 

□ 

||5 The present invention also extends to a data transmitter for transmitting data received from an 

^ information source via a communications channel, the data being encoded by the transmitter into a 

$ low-density parity-check (LDPC) code word, the transmitter comprising: matrix definition logic 

is 

□ for defining a first MxN parity check; a triangular matrix generator for generating a second parity 

Cl check matrix based on the first parity check matrix; the second parity check matrix having an 

2© MxM triangular sub-matrix; and, an encoder for mapping the data into an LDPC code word 

M based on the second parity check matrix. 

The present invention further extends to a data storage system for storing data received from an 
information source in a data storage channel, the data being encoded by the system into a 
25 low-density parity-check (LDPC) code word, the system comprising: matrix definition logic for 
defining a first MxN parity check matrix; a triangular matrix generator for generating a second 
parity check matrix based on the first parity check matrix; the second parity check matrix having 
an MxM triangular sub-matrix; and, an encoder for mapping the data into an LDPC code word 
based on the second parity check matrix. 

30 
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Parity-check matrices thus provided lead to LDPC codes having linear-time encoding complexity. 
Such matrices are fully deterministic and can be specified via a small number of parameters. Also, 
such matrices require a minimum amount of, or no, preprocessing. The performance of the 
obtained codes is as good as or better than the randomly constructed LDPC codes. 

5 

Preferred embodiments of the present invention to be described shortly utilise parity-check matrix 
constructions for so-called "array codes". Array codes are described by M. Blaum, P. Farrell, and 
H. van Tilborg, "Array codes," in Handbook of Coding Theory, V S. Pless and W.C. Huffman 
Eds., Elsevier 1998 . The direct application of array-code constructions to obtain LDPC 

10 parity-check matrices are described in J. L. Fan, "Array codes as low-density parity-check codes," 
Proc. Int. Svmp. on Turbo Codes, Brest, France, pp. 543-546, Sept. 2000, and E. Eleftheriou and 
S. Oelcer, "LDPC codes for G.dmt.bis and G.lite.bis," International Telecommunication Union, 
ITU-T. Study Group 15 / Question 4. Temporary Document CF-060. Clearwater. FL. 8-12 Jan. 

l §. 2001. Although the codes in the last mentioned two references are specified via a small number of 

1 1 parameters, they are not linear-time encodable. 

'•%".$ 

i IH 

i3 Brief Description of the Drawings 

iii 

n 

t 3 

, Preferred embodiments of the present invention will now be described, by way of example only, 

20 with reference to the accompanying drawings, in which: 

rl 

huh 

Figure 1 is a block diagram of a communications system; 

Figure 2 is a block diagram of a transmitter for the communications system; 

25 

Figure 3 is a block diagram of another transmitter for the communications system; 
Figure 4 is a block diagram of an matrix generator for the transmitter; 



30 



Figure 5 is a flow chart corresponding to an encoder function of the transmitter 
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Figure 6 is a flow chart corresponding to the matrix generator; and 
Figure 7 is another flow chart corresponding to the matrix generator; 
S Figure 8 is a block diagram of a data storage system; and, 

Figure 9 is a block diagram of another example of a transmitter for the communications system. 

Detailed Description of Illustrative Embodiment 

10 

Referring first to Figure 1, a preferred embodiment of the present invention comprises a 
transmitter 10 for connection to a receiver (not shown) via a communication channel 20 such a 
4f Digital Subscriber Line (DSL) communications channel. In operation, the transmitter 10 receives 
u| a sequence of information bits 30 from an information source 40 such as a computer system, 

Ijf mobile telephone, fixed line telephone, or similar data communications endpoint. The transmitter 

Ms 

^ 10 converts the information bits 30 into symbols 50 for transmission to the receiver via the 

l M channel 20. 

£ 

Referring now to Figure 2, in a particularly preferred embodiment of the present invention, the 
20 transmitter 10 comprises a divider 100, a block encoder 1 10 connected to the divider 110 and a 
u symbol mapper 120 connected to the block encoder 1 10 and the divider 100. A parity check 
matrix generator 160 is connected to the encoder 1 10. In operation, at each modulation instant, 
the divider 100 divides a set of information bits 30 from the information source 40 to be 
communicated into a first group 130 and a second group 140. The block encoder 1 10 encodes the 
25 second group 140 to generate a block code 150 based on a parity check matrix provided by the 
matrix generator. The parity check matrix is generated by the matrix generator based on code 
parameters 170. The symbol mapper 120 selects a subset of symbols in a constellation of symbols 
in dependence on the block code 150 according to a Gray-coded mapping function. The symbol 
mapper 120 also selects a symbol within the subset in dependence on the first group 130 
30 according to a Gray-coded mapping function. The selected Symbol 50 is then communicated to 
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the receiver via the channel 20. The divider 100 may implemented by a shift register or similar 
logical function. It will be appreciated that the transmitter 10 may be implemented by hardwired 
logic, by a general purpose processor or dedicated digital signal processor programmed with 
computer program code, or by a combination of hardwired logic and computer program code. 

5 

Referring now to Figure 3, in a modification to the transmitter 10 herein before described with 
reference to Figure 2, the divider 100 is omitted and the block encoder 110 encodes all the 
information bits 30 received from the information source 40 to generate the block code 150. The 
symbol mapper 120 selects a symbol in a constellation of symbols in dependence on the block 
10 code 150 according to a Gray-coded mapping function. The selected symbol 50 is then 
communicated to the receiver via the channel 20. 

4* With reference to Figures 4, in a preferred embodiments of the present invention, the matrix 

tt;3 

U'l generator 160 comprises matrix definition logic 300 connected to a triangular matrix generator 

Cj 

>| 310. With reference to Figure 5, in operation, at step 350, the matrix definition logic 300 defines a 

first MxN parity check matrix 320 based on input code parameters 170. At step 360, the 

&l triangular matrix generator 310 generates a second matrix based on the first matrix. The second 

□ matrix has an MxM triangular sub-matrix. At step 370, the second matrix is supplied from the 

y matrix generator 160 to the encoder 1 10. Data input to the encoder 1 10 is then mapped LDPC 

10 code words based on the second matrix. Two approaches to definition of the parity check matrix 

i _i 

and the generation of the triangular matrix in preferred embodiments of the present invention will 
now be described with reference to Figures 6 and 7. 

Referring to Figure 6, in a preferred embodiment of the present invention, matrix generation 
25 comprises three steps, 1, 2, and 3. In step 1, a matrix H is defined according to the definition of 
parity-check matrices for array codes. Step 2 is a triangularization step that deterministically 
modifies the matrix H to achieve an upper-triangular structure. Step 3 includes a simple procedure 
to eliminate 4-cycles that may have been introduced in the second step. 



30 



Step 1 : Definition of H 



+ 



11 
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The array-code like LDPC parity check matrix H is defined by three parameters: a prime number 
p and two integers k and j such that k,j < p. The matrix H has dimensions jpxkp and is given by 



H= 



I I 



I o 2 



a' 



I at 1 o 2 ^" 0 ••• a°~ m ~ X) 



I 

a k-x 

a 2(k-l) 



where / is thep xp identity matrix and a is a p xp permutation matrix representing a single left or 
right cyclic shift. For example: 



0 10 0 0 

0 0 10 0 

0 0 0 1 0 

0 0 0 0 1 

.1 0 0 0 0 



or a = 



0 0 0 0 1 

1 0 0 0 0 
0 10 0 0 
0 0 10 0 
0 0 0 1 0 



The parameters j and k provide the column and row weight of H, respectively. By construction, 
the matrix H is 4-cycle free. In other words, there are no two rows that have overlapping ones in 
more than one position. 

H represents the parity-check matrix of a family of LDPC codes with code word length N- kp 
and number of parity checks M=jp. An LDPC code with code word length N* < N or number of 
parity checks M 1 <M \% easily obtained by discarding the N-N rightmost columns and the 
M-A4 1 lowest rows of H. The resulting Af x N* matrix is then used instead of H in steps 2 and 3,^. 
with obvious modifications to the sizes of the matrices involved. 



Step 2: Triangularization ofH 



Let /f be represented in the block-matrix form 
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H=[H X I H 2 ] 

where Hi has dimensions jp x jp and H 2 has dimensions jpx(k- j)p. Let U be the jp x jp 
upper-triangular matrix obtained from H\ by replacing each element on the main diagonal of H\ 
5 with a 1 and by setting all the elements below the main diagonal to 0. The jpx/tp matrix 

Hu = [u\ H 2 ] 

defines the parity-check matrix of a linear-time encodable LDPC code. 

Note that, although the matrix H is 4-cycle free by construction, Hu may not be free of 4-cycles 

due to the introduction of the upper triangular matrix U. However, 4-cycles are easily detected 
and eliminated as demonstrated in the next step. 

Step 3: Elimination of 4-cycles 

Let A = Hu • Ha, where T denotes matrix transposition. The diagonal element a m ^ m = 1, . . .Jp 
of A gives the Hamming weight of row m y i.e., the number of symbols checked by the 
parity-check m of matrix Hu. The off-diagonal element a m ,„, m,n = 1, m * n, gives the 

number of symbols checked by both parity-check m and parity-check n. In the absence of 
4-cycles, a m , n <\. 

Therefore, to ensure that the parity-check matrix is free of 4-cycles: 
25 (a) Compute the lower-triangular part ofA-Hu-Hjj. 

(b) If a m ^ > 1, (m f n = 1, ...Jp, m < w), set the (w,/w)-th element of Hu equal to zero. 
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Denote by Hu the matrix that is obtained at the end of Step 3. The LDPC code defined by Hu 
has code word length N=kp, number of parity checks M =jp, and information block length K = 
(k-j)p. Linear-time encodability using Hu is shown in the next section. 

5 Efficient encoding is achieved directly from the parity-check matrix Hu without the need to 
compute the generator matrix of the code. Recall that since LDPC codes are linear block codes, 
an N-tuple x is an LDPC code word if and only if Hu • x = 0, where 0 is the Mx 1 null vector. 
The vector jc may be expressed in the form 



10 



x = 



P 

s 



n 
m 

in 



where the jp x 1 vector p represents the parity part and the (k -j)px\ vector s represents the 
systematic part of the code word jc. The jp parity bits in p are obtained in a recursive manner by 
employing 



p 

s 



= 0 



20 



and exploiting the upper-triangular form of Hu. To demonstrate this, let both vectors p and s be 
split into p x 1 sub-vectors 



P = 



P2 



and s = 



S2 



L Pi 



Sk-j 



where p, = {p^; n = 1, 2, . . .,p), i =1,2,. ..J and s, = {s u „,n =1,2,.. .,/?}, i = 1, 2, . . ., k-j. Then 
the elements of p m are obtained for w = /, y - 1, . . 1 by the set of recursions 



25 



# 

j H 

Pmj> ~ S, A- +2 *«,... 

0=mfl {=1 

j H 

Pmj>-\ =(Pmj>)+ S Pi,... + Z *«,... 

( = bH-1 i = 1 

5 ; 

J H 

J = OT+1 C= 1 

where the second sub-indices of /^...and which depend on the particular values assumed by 
the power of the matrix a, have been omitted to avoid notational burden. The terms shown in 
parentheses may actually not be present, depending, again, on the particular values of the power 
of the matrix a . 

The above encoding process thus takes advantage of the triangular structure of the parity-check 
matrix ifu as well as of its sparsity. It can be shown that encoding requires about 

f[/0+r) + (l-f)(l-r)] 

XOR operations, where r is the rate of the code. 

Referring now to Figure 7, a modification to the approach herein before described with reference 
to Figure 6 comprises two steps, V and 2\ Steps V and 2' will now described in detail. 

Step V: Definition of H s 

25 A matrix H s is defined by cyclically shifting, in a blockwise manner, the rows of the matrix H. 
The amount of cyclic shift for each block-row is such that the jp x jp leftmost subblock of H s 
contains the identity matrix / along its diagonal: 
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I 

a" 

a 2(k-2) 



I 
I 

a 2(fc-l) 



/ 

a 
/ 



I I 

at 2 a/~ l 

a 2U-3) a 2Q-2) 

I at 1 



I 

a k ~ 2 

a 2(*-3) 
a (HX*-D 



Since H s has been obtained from H via cyclic shifts only, it has column and row weights given by 
j and k, respectively, and is free of 4-cycles. 

Step T : Triangularization of H s 

The matrix H 8 is triangularized by replacing with zeros the lower-triangular elements of its jp x jp 
leftmost subblock. As a result, the matrix Hfj is obtained: 



Hf; = 



III 

Ola 
OOI 

O O 



I I 

at 2 aT x 

fl 2(r3) a 2(j-2) 



o 



at 



I 

a" 2 

a 2(k-3) 
a (i-W-i) 



where O is the pxp null matrix. 

The LDPC code defined by H s v has code word length N=kp, number of parity checks M =jp, 
and information block length K = (k-j)p. Also, Hfj is 4-cycle free. Clearly, LDPC codes defined 
by Hy are linear-time encodable. 

An LDPC code with code word length W < N or number of parity checks M* < Mis easily 
obtained by discarding the N-N 1 rightmost columns and the AY -A/ lowest rows of H v . 

Efficient encoding is achieved in the same manner as herein before described with reference to the 
approach herein before described with reference to Figure 6. It can be shown to require 



• 
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f[r</ + 3) + </-3)] 



XOR operations, where r is the rate of the code. 

The parity-check matrices obtained in the embodiments of the present invention herein before 
described with reference to Figures 6 and 7 have a triangular form. In references D, J. C. 
MacKav, S. T. Wilson, and M. C. Davev. "Comparison of constructions of irregular Gallager 
codes." IEEE Trans, on Communications. Vol. 47. No. 10. pp. 1449-1454, Oct. 1999 and R. 
Richardson and R. L. Urbanke, "Efficient encoding of low-density parity-check codes. " IEEE 
Trans, on Information Theory. Vol. 47.. No. 2. pp.638-656. Feb. 2001 , it is shown that fast 
encoding is also possible for LDPC codes having a parity-check matrix in "approximate 
triangular" form 



where C, D, E and T are matrices of appropriate dimensions and T matrix is upper-triangular. 
Such a form can be efficiently obtained by generalizing the approaches herein before described 
with reference to Figures 6 and 7 

For example, if the approach herein before described with reference to Figure 6 is followed, then 
to generate an approximate triangular form, Step 1 remains the same, but the matrix H is now 
equivalently written in block-matrix form as 



where H$ is a tpxtp matrix, with the integer / < y, and the matrices /f 3 > H 4 and H 6 have 
appropriate dimensions. A triangularizaton step similar to Step 2 is the applied to H 5 . Let U$ be 
the tp x tp upper-triangular matrix obtained from H 5 by replacing each element on the main 
diagonal of H$ with a 1 and by setting all the elements below the main diagonal to 0. 
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The jpx hp matrix 

H3 H4 

. U 5 He J' 

5 

is in approximate triangular form and therefore defines the parity-check matrix of a fast encodable 
LDPC code according to the aforementioned references D. J. C. MacKav. S. T. Wilson, and M. 
C. Davev, "Comparison of constructions of irregular Gallager codes/' IEEE Trans, on 
Communications. Vol. 47. No. 10. pp. 1449-1454. Oct. 1999 and R. Richardson and R. L. 

10 Urbanke. "Efficient encoding of low-density parity-check codes. " IEEE Trans, on Information 
Theory. Vol. 47.. No. 2. pp.638-656. Feb. 2001 . Step 3 then is applied to this approximate 

y triangular matrix to eliminate possible 4-cycles. 

'ess 

n 

n \ Clearly, the matrix H in Step 1 can be rowwise and columnwise truncated to achieve specific 

; ''iff 
•S.iA 

t jj values for the code word length and number of parity checks. 

h As indicated earlier, the approach herein before described with reference to Figure 7 can also be 
^ used to obtain a parity-check matrix in approximate triangular form. To this end, Step 1 ' is altered 
M by cyclically shifting to the right the / - 1 lower block-rows of the matrix H s . That is, the lowest 
Ip block-row is shifted by / - 1 positions, the next upper block-row by t - 2 positions, etc. Then, 
Step 2' is applied, but only to the tpxtp lower-left submatrix of the so-obtained matrix, resulting 
in a new matrix with approximate triangular form. The overall matrix is then in approximate 
triangular form and free of 4-cycles and can directly be used for fast LDPC encoding following IX 
J. C. MacKav, S. T. Wilson, and M. C. Davev. "Comparison of constructions of irregular 
25 Gallager codes," IEEE Trans, on Communications. Vol. 47, No. 10, pp. 1449-1454. Oct. 1999 
and R. Richardson and R. L. Urbanke. "Efficient encoding of low-densitv paritv-check codes. " 
IEEE Trans, on Information Theory. Vol. 47.. No. 2, pp.638-656, Feb. 2001 . 
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Again, the matrix obtained at the end of Step 2' can be rowwise and columnwise truncated to 
achieve specific values for the code word length and number of parity checks. 

In some embodiments of the present invention, the parity check matrix may be defined by the 
5 matrix definition logic 300 upon connection of the transmitter 10 to the receiver via the 

communications channel 20. For example, the matrix may be built by the matrix definition logic 
300 on connection based on dimensions negotiated between the endpoints of the channel 20. 
Specifically, the parity check matrix may be determined based on supply of the code parameter 
170 to the transmitter 10 from the receiver 20. In other embodiments of the present invention, the 
10 parity check matrix may be defined by the matrix definition logic 300 in advance of a connection 
being established. For example, one or more parity check matrices may be preset within the matrix 
definition logic 300, with the or each preset matrix having a preset code length (number of 

4| columns) and a preset number of parity checks (number of rows). In embodiments having multiple 

yj 

tfi preset matrices, an appropriate matrix is selected to the matrix definition logic 300 on 

Pi 

f I establishment of the connection. Such a selection may be performed, for example, based on a 

"Jj negotiation between the endpoints of the channel 20 as herein before described. 

y I 

. h 
s 

r) Preferred embodiments of the present invention have been herein before described with reference 

: j to communications systems. However, the present invention is not limited in application to such 

2© systems. For example, referring to Figure 8, the embodiments of the encoder 110 herein before 

U described may also be employed in a data storage system 210 for storing data from the 
information source 40 in a storage channel such as a hard disk storage channel. 

It will be appreciated that the examples of the transmitter 10, encoder 110, and matrix generator 
25 160 herein before described may each be implemented by hardwired logic, by a general purpose 
processor or dedicated digital signal processor programmed with computer program code, or by a 
combination of hardwired logic and computer program code. For example, referring to Figure 9, 
in the data communications system herein before described with reference to Figure 2, the 
transmitter 10 may comprise a programmable digital signal processor (DSP) 400 connected to a 
30 memory 410, with computer program code 420 stored in the memory 420 which, when executed 
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by the DSP 400, configures the DSP 400 to perform the steps of the method herein before 
described with reference to Figure 5. 

While the invention has been described herein with reference to preferred embodiments, it will be 
appreciated by those skilled in the art that various changes in form and detail may be therein 
without departing from the scope of the invention. 



